Papers with contrastive learning scheme
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing multilingual machine translation approaches focus on English-centric directions, while non-English directions lag behind. |
| Approach: | They propose a multilingual machine translation system with an emphasis on non-English directions. |
| Outcome: | The proposed model outperforms existing models on English-centric and non-English directions on multilingual translation benchmarks. |
Improving Continual Relation Extraction through Prototypical Contrastive Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. |
| Approach: | They propose a Continual Relation Extraction framework with Contrastive Learning which is built with a classification network and a prototypical contrastive network to achieve incremental-class learning of CRE. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on two public datasets and proves its effectiveness on improving performance. |
HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing self-supervised methods in natural language processing rely on augmentation rules to generate contrastive samples. |
| Approach: | They propose a hierarchy-aware information lossless contrastive learning scheme that uses syntactic information reserved in the input sample and fused during the learning process. |
| Outcome: | The proposed learning scheme is superior to existing methods in hierarchical text classification . the proposed learning system is based on a structure encoder and a text encoder . |
WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings (2023.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on seven semantic textual similarity tasks show our method achieves consistent improvement over the contrastive learning baseline and sets new states of the art. |
| Approach: | They propose a whitening-based contrastive learning method for sentence embedding learning which combines contrastive and shuffled group whitening. |
| Outcome: | The proposed method achieves better alignment and uniformity on seven semantic textual similarity tasks. |